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Abstract 



We consider the analysis and design of space-time trellis codes (STTCs) for 
a cooperative relay channel operating in amplify-and-forward (AF) mode as- 
suming the source and destination nodes are equipped with multiple antennas 
but the relay node has single antenna. We derive a pairwise error probability 
(PEP) expression for the performance of STTCs in this type of channels. A 
simple upper-bound on PEP is then derived and is maximized to find the opti- 
mum STTCs. We show that the designed STTCs based on the derived criterion 
achieve full diversity in the AF relay channels especially at high signal-to-noise- 
ratios (SNRs). The maximum achievable diversity in relay channels with single- 
antenna relay is bounded by min(M, TV) where M and N are respectively the 
number of antennas in source and destination nodes. Simulation results confirm 
that the proposed codes achieve the maximum diversity and also provide an 
appealing coding gain. 



0.1 Introduction 



Cooperative communication is an effective way to improve diversity gain in wire- 
less channels. Among cooperative communication schemes, the use of relaying 
has received a lot of attention in recent years [l]-[3], [11]. Most current research 
appears to focus on half-duplex operating relays as in the amplify-and-forward 
(AF) protocol because of its simplicity and feasibility. In the AF relaying pro- 
tocol, often simply called AF protocol, the relay amplifies the received version 
of the transmitted source signal and transmits this amplified version to the 
destination. 

On the other hand, multi-antenna techniques offer significant improvements 
in link reliability through the use of multiple antennas at the transmitter and/or 
receiver without incurring system losses in terms of delay and bandwidth effi- 
ciency. A significant advantage of multi-input-multi-output (MIMO) communi- 
cations is the ability to provide a sound trade-off between diversity and mul- 
tiplexing gains. The idea of using multiple transmit and receive antennas in 
wireless communication systems has attracted considerable attention with the 
aim of increasing data transmission rate and system capacity. A key issue is how 
to develop proper transmission techniques to efficiently exploit all the diversity 
gain offered by MIMO channels [3], [5], [6]. Space-Time Trellis Coding (STTC)[4] 
is an efficient transmission strategy in MIMO channels that enhances data rate 
and/or the reliability of communications over fading channels. Data is encoded 
by a trellis code and the encoded data is split into several streams that are 
then simultaneously transmitted using multiple transmit antennas. While the 
decoding complexity of STTCs is generally higher than linear Space- Time Block 
Codes (STBCs), they can provide larger diversity and coding gains [10]. 

While the design and evaluation of STTCs for point-to-point MIMO channels 
has been well investigated, the problem of STTC design for communication 
networks is still under study. There are several papers discussing space-time 
coding for cooperative communication [12]; but to the best of our knowledge, 
a general analysis on the design of STTCs in the cooperative relay systems 
operating in AF mode has not been done. 

In this paper, the design and evaluation of STTCs for Rayleigh-faded co- 
operative channels with AF relaying is considered. As in many applications, it 
is desirable to keep the complexity at the relay node low, we consider single- 
antenna relay node throughout this paper. To design efficient STTCs for this 
scenario, pairwise error probability (PEP) is adopted as the performance mea- 
sure. A proper metric for the design of STTCs in relay channels with multi- 
antenna source and destination and single-antenna relay nodes is derived based 
on an upper-bound on PEP. The derived bound is then used to design STTCs 
that outperforms the codes suggested in [4] in terms of bit-error-rate (BER). 
Finally, various numerical examples are provided to corroborate the analytical 
studies. 

The remainder of this paper is organized as follows: a general model for AF 
relay channels with multi-antenna source and destination and single- antenna 
relay nodes is presented in Section II. In Section III, the PER criterion is in- 
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Figure 1: A MIMO cooperative scheme operating in amplify-and- forward (AF) 
mode with single-antenna relay node 



troduccd and an upper-bound on PEP is derived. The code design rule based 
on the derived upper-bound is then discussed. Simulation results for a variety 
of source and destination antenna combinations is presented in Section IV and 
Section V concludes the paper. 

0.2 System Model 

Fig. 1 shows the general structure of the AF relay system under study. Node 
Ti sends its information to node T2 through an intermediate single-antenna 
relay node, R. It is assumed that R receives the signal from Ti in one time- 
slot, amplifies the received signal and forwards it to T2 in the next time-slot. 
Wc further assume that Ti and T2 are equipped with M and N antennas, 
respectively, and R is a single-antenna relay node. All the channels are assumed 
to be flat-fading. Under these conditions, the received baseband signal at R in 
the first time-slot is: 

x = hs + n 1 (1) 

where x is the received signal at the relay; s is the (M x 1) transmitted vector 
from Ti; n\ ~ A(0,<ti 2 ) is the complex circularly symmetric additive white 
Gaussian noise (AWGN) samples; and h is (1 x M) channel vector from Ti to 
R. Upon receiving the signal from Ti, the relay R processes it with AF relay 
operation, and then broadcasts the processed signal to T 2 during the second 
time-slot. Mathematically, the linear processing operation at the relay can be 
concisely represented as r = ax. For the sake of simplicity and without loss of 
generality, we assume a = 1. The received signal in T2 can then be written as: 

y = gr + n 2 (2) 
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where 112 ~ ./V(0, <73l/v) is the zero-mean circularly symmetric complex AWGN 
vector at node T2. By substituting (1) in (2), the received signal at T2 will be: 

y= ghs + gni+n 2 ^ (3) 

signal noise 

we can rewrite the above equation as following: 

s = Hs + n (4) 
where H = gh is a rank one matrix and 

n^N(0,((a 1 2 a g 2 + a 3 2 )I N )) (5) 
where H = g r h and ni ~ N(0, {cr 2 a 2 r + a- 3 2 )I/v) where a 2 r = ^{grgr^}. 

0.3 Pairwise Error Probability 

PEP is the probability of a particular codeword c in a codeword set being 
decoded as another valid codeword c' at the receiver and is defined as [10]: 



P(c^c')=Q(^^||H(c-c')f) (6) 

where E s is the received signal energy, Nq is the power spectral density of noise, 
and Q(x) is the Gaussian Q-function defined as: 

Q(x) = -= / e-^d\ (7) 



2tt 

The probability of detection error for a particular codeword set C can be written 
as the weighted sum of the PEP terms as: 

Pe<]TP(c)]rP(c^c') (8) 

cec c'^c 

where P(c — > c') represents the PEP and P(c) is the probability of transmission 
of codeword c. The PEP can be derived by using the Moment Generating 
Function (MGF) method [s]. The Q-function can be alternatively expressed in 
the Craigs formula as [7]: 

Q{x) = I [ 2 e -(*i3WdA (9) 



Integrating over all possible channel realizations results in an average PEP ex- 
pression involving the MGF, i.e., 

p(c -> c,) = a 2 M " Hn " 2 (-it£t^) dip - m " h "» 2 (-^) (io) 
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where M|| H o|| 2 ( s ) = £{e l|H - a| s } is trie MGF of the random variable ||H.fl|| 2 , 
SI = (c — c'), and tp is a dummy variable. The upper-bound M||Hf2|| 2 ( — 
for the average PEP in (10) is obtained using the Chernoff bound. Our objec- 
tive is to find STTCs that minimize the upper-bound in (10) and hence will 
result in minimum average PEP. Note that this upper-bound includes the MGF 
of ||H.f2|| 2 . Therefore, in the next step we analytically derive a closed-form 
expression for this MGF. 



0.3.1 Calculation of Moment Generating Function 

Using H = g r h, one can write: 

||g r M2|| 2 = tr ( gr hm2 H h ff g r ff H|g r || 2 ||hft|| 2 = a.b (11) 

Since g r is a Gaussian vector with jointly independent elements, a = ||gr|| 2 
has a chi-square distribution with TV degrees of freedom, i.e. a ~ X%n- Let 
J~iO H = U H AU be the eigenvalue decomposition of fifi H in which U is a 
unitary matrix and A = diag(Xi, Ajv/) where Ai, Xm the eigenvalues of 
l~2f2 H . Since Jlf2 H is symmetric positive definite, Aj's are non- negative. Also, 
the vector g is circularly symmetric Gaussian vector whose elements are jointly 
independent. We define: 

M 



\hSlf =J2Mhif (12) 



In (12) the random variable \hi\ 2 is exponentially distributed; thus, b has a 
non-central chi-square distribution. The MGF of b can then be calculated as: 

M 

M b ( S ) = E{e* b }=ll T - J - s (13) 

i—l 

To derive the MGF of ||H(c — c')j| 2 = a.b we will use the following theorem. 
Theorem 1 The MGF of ||H.fJ| " 



OO 

x N ~ x .e 



Mm - nll * (s)= mJ n^-^) dx (14) 

where T(TV) is the standard Gamma function. 

Proof 1 Since ||H.J1|| 2 = a.b where a and b are two independent positive ran- 
dom variables with probability density functions f a (.) and /&(.) , it follows that 



oo 

^||H.n|p (a) = J e sv f\\H.n\\*{v)dv 
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oo oo 

v K dr , 7=2 



e sv I f a (r)f b (-)-dv r = I f a {r) \ e srl f b (l)dl dr (15) 







As a ~ X2N ' fa( x ) — x v(N) — • r ^ ie secon d integral is the MGF of random 
variable b. Replacing f a (x) and the MGF ofb, M b (sx), from (13) into (15), we 
obtain ( 14 )■ 

The integral in (14) cannot be calculated directly. Instead, we will use an 
approximation method in Section III.B to calculate it. 

0.3.2 Approximation of Moment Generating Function 

To analyze the system at high signal-to-noise-ratios (SNRs), we can look at the 
-^||h.o|| 2 ( s ) obtained in (14) for large values of s. We can then approximate 
the integral in (14) to find simple closed- form code design criteria. To this aim 
we state the following theorem. 

Theorem 2 If all eigenvalues of fZf2 H are strictly positive and distinct; then 
^||H.r2|| 2 ( s ) can be approximated at large s as: 



t(n-m) (-i) M 



N > M 



M l|H.n|pO0 = • 



M s M 

r(JV) n K 

i~ (-i) M l ? g(- S ) N-M 
r(N) n K 

i=l 

M M 



Proof 2 We consider two different cases: (a) N > M; and (b) N < M; 
(a) For N > M, (14) can be rewritten as: 



r(iv) iUi (Aia) j n i= i (—s - x ) 



(-1) 



M 



x N - M -\e- x dx 





M 



f-ir 

1 f m - : r(iV-M) (17) 



r(Aon:=i(Ais) 

To derive the second equality, we use the fact that \[f =1 (^ - x) > (-1) 
for large s. 
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(b) For N < M , using the following identity ([9], chapter 7): 

oo 

f x N ' 

I rE7 



dx 



fi^,) can i/ien 6e rewritten as: 

^IIH.^Ip (s) = 

1 * f / « A \ / r^e" 

-dsc I V (19) 









(n 




yii=i,ii7ti 



Ai — Xi ± } \ J 1 — A;sx 
The integral in (19) behaves asymptotically as [9]: 

nn 

x N-l e - X 

ax = 

1 — Xisx 

T(N-j) (lo ga -r(l)) logAi 

where T'(l) is differentiation of normal gamma function T(x) in x = 1. By 
substituting the approximation (20) into (19), we have 

N-l I M ( M . \ \ ., 

( M 1 x / M x \ \ 



^T(N)s« I ^ Af I . 11 I I 

V =1 \n=i,»iw / / 

If N — M , the first term becomes zero and for summation of two other terms 
we can write: 



(-i) N (logs-r'(i)) 
|Hf!|| 2 k a ) - r(N) YliLi sN 



ff 1^7 U (22) 



. (-1)" log(-s) 

' r(JV) n f = i Ai s N 
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If N < M, the second term in (21) is zero and the summation will be: 




(23) 



According to Theorem 2, the diversity order offered by a AF relaying with 
single-antenna relay is bounded by min(M, N). This is expected because this 
structure can be interpreted as the cascade of a multi-input-single-output (MISO) 
and a single-input-multi-output (SIMO) channel with maximum diversity order 
of M and N, respectively. Besides, Theorem 2 provides the maximum coding 
gain offered by this relay scheme which can be used in the design of better 
space-time codes for AF relaying with single-antenna relay. 



0.3.3 Code Design 

To design optimum STTCs for AF relaying with single-antenna relay, we con- 
sider two different cases: 1) For N > M, according to Theorem 2, the determi- 
nant criterion in [4] provides the optimum STTCs. 2) For N < M, the coding 
gain in (16) has a new form different from [4], and to minimize the PEP, the 
following metric should be minimized: 



* log Aj 

=i Xi N 



(u 

n 

«i=i 



\ 



Aj 

A? — \i x 



(24) 



0.4 Conclusion 

In this paper, the design of STTCs for AF relay channels with multi-antenna 
source and destination and single-antenna relay nodes was discussed. Based 
on the derived upper-bound for PEP, a code design rule was established for 
constructing optimal STTCs. The derived four-state QPSK codes with rate 2 
bps/Hz for different numbers of transmit and receive antennas were shown to 
outperform the STTCs in [4] over Rayleigh fading channels. The performance 
gain obtained by using the proposed codes increases with the number of transmit 
antennas. Also, we proved that the diversity order offered by STTCs over an 
AF with single-antenna relay is bounded by min(Af, N). 
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